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VISUAL MAGNIFICATION APPARATUS AND METHOD 

BACKGROUND OF INVENTION 

This application claims benefit of priority under 35 U.S.C. §1 19(e) to U.S. 
Provisional Application Serial No. 60/446,439, filed on February 10, 2003. 

5 1 . Field of the Invention 

The present invention generally relates to a document viewing system, 
with particular relevance to Visual Display Units (VDU). 
2. Description of the Related Art 

Numerous devices exist in the current art for magnifying visual 

10 information. In particular, the area of reading devices for the visually impaired 
provides many examples of devices which aid the user in reading books, 
magazines and the like. The present invention is concerned only with the visual 
representation of such information, as oppose to audio translation of textual 
information, i.e. machines which read aloud, using a synthesized voice. 

15 Recent releases of MICROSOFT WINDOWS, such as WINDOWS 98, 

WINDOWS 2000 and the like, have all provided improvements for increasing the 
readability of text on VDUs, in relation to the visually impaired user. The 
improvements utilize high contrast color schemes, using fonts of increased size 
and providing a simple utility known as MAGNIFYING GLASS. This is a tool 

20 which emulates the magnifying capabilities of a spyglass, such that moving the 
cursor around the screen moves a virtual spyglass, effectively magnifying the 
portion of the screen directly below the cursor. The virtual spyglass merely 
serves to stimulate developer's thoughts in the field of improving readability of 
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displayed materials and is not intended to meet the characteristics described 
herein. Specifically, the virtual spyglass lacks awareness of the present user's 
individual needs. The program does not automatically determine what 
magnification factor to use. 

5 Other magnification devices, such as overhead projectors, binoculars, and 

spectacles, lack an automatic adjustment for the user; are made for a specific 
user; or are too cumbersome to be adapted for use by a single person. . 

The norm for present day word-processing, and other data processing 
tools is to provide increase the font size used to represent a document being 

10 viewed by the user. An example of this method can bee seen in MICROSOFT 
WORD, where the user selects a magnification factor expressed as a 
percentage, with default settings ranging from 10% to 500%. As with previously 
described devices, this method of magnification lacks the ability to automatically 
adjust the font size to the user's needs, which vary in real time, as the user's 

15 distance from the screen increases and decreases. 

Therefore a method of automatically controlling the magnification factor of 
material displayed on a VDU, by means of sensing the user's distance from the 
VDU is not found in the prior art. 

SUMMARY OF THE PRESENT INVENTION 

20 It is an aspect of the present invention to provide a user with a dynamically 

sized image, which appears to be a constant size, regardless of the user's 
distance from the VDU displaying the dynamically sized image. The user is able 
to control the point upon a viewed image at which magnification occurs. The 
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user may issue commands by hand or body movements. Also, each user of a 
particular VDU equipped with the invention is able to store the user's 
requirements as rules which direct the magnification behavior of the invention. 
The invention provides facilities for effectively canceling the effects of 
5 perspective, which causes objects that are far away to appear smaller as the 
user moves away from them. In particular, a VDU when connected to a personal 
computer will dynamically resize the information such that it appears to be the 
same size on the screen regardless of whether the user moves closer or farther 
away from the VDU. 

10 When a user moves away from his/her VDU, the image on the screen, 

typically made up of textual information, will remain legible. This is particularly 
useful for users having common vision impairments which are typically corrected 
by glasses or contact lenses. 

The invention provides a preferred text size to maintain the size of an 

15 image, despite the fact that the user may move closer to a further away from the 
image. 

If a user wore a pair of clear non-prescription glasses having a measuring 
scale etched on the lenses, such that the user could describe how tall an object 
appeared to be when viewed through the lenses, then the user would observe 
20 that an image displayed on a VDU related to the present invention stayed at a 
constant size. The image would not grow progressive smaller, as would naturally 
occur when the user moved away from the image. 
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To further clarify the manner in which the invention works; if the user 
described a text character on the VDU as being 10 millimeters high, when viewed 
from a distance of 1 meter, then, even when the user moved away to a distance 
of 2 meters, the text character would still appear to be 10 millimeters high. This 
5 behavior is facilitated by the fact that the invention dynamically resizes the text 
character, and indeed, all information displayed on the VDU, to maintain an 
apparently constant size. 

Other aspects, features and advantages of the present invention will 
become obvious from the following detailed description that is given for one 
10 embodiment of the present invention while referring to the accompanying 
drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is an illustration of visual magnification apparatus in accordance with the 
invention. 

15 Fig. 2 is a graph showing the time plot of a simple gesture command in 
accordance with the invention. 
Fig. 3 is a graph showing how the image remains substantially constant over 
distance as well. 

DETAILED DESCRIPTION OF THE INVENTION 
20 The invention is an information processing apparatus and method 

having at least one VDU, typically utilizing a central processor as provided within 
a personal computer. A sensor which measures the distance between the user 
and the VDU is also provided. The purpose of the sensor enables the computer 
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to determine the distance of the user in relation to the VDU, such that the size 
and content of information displayed upon the VDU can be automatically 
adjusted. 

The software logic of the preferred embodiment behaves in such a way 
5 that as the user moves away from the VDU, the CPU causes the image rendered 
upon the VDU to enlarge any displayed information, thus counteracting the 
effects of perspective, which makes objects appear smaller the further away they 
are from the viewer. 

Figure 1 is an illustrative overview of the invention depicting example 
l o positions for user 1 00 and sensor 110. 

Sensor 1 10 is a statically positioned measuring device which emits a 
signal, that when returned, enables sensor 1 10 to discern the distance between 
itself and any object at which it is pointed. Sensor 1 10 is known in the art in 
several forms, commonly appearing as ultrasonic tape measures or similar such 
15 instruments. 

Sensor 1 10 is connected to CPU 130, such that the distance between 
user 100 and VDU 120 is reported to CPU 130, which can then act upon the 
distance reported by sensor 110. Sensor 1 1 0 could be connected to the CPU 
130 via an RS-232 connection or a parallel connection or by using a USB port, all 
20 of which are well known in the art. 

Sensor 1 10 constantly records the distance between itself and user 100. 
Last recorded distance is defined as the most recent sample taken by sensor 100 
to find the distance between itself and user 100. 
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Refresh rate is defined as the number of times per second that CPU 1 30 
periodically queries sensor 100 to retrieve the last recorded distance. 

Devices suitable for use as sensor 100 typically capture distance 
information many hundreds of times per second. CPU 130 will typically only use 
5 a refresh rate of approximately 25 times per second. The refresh rate can be 
modified in alternate embodiments to provide smoother transitions in size as the 
invention alters the magnification factor used to increase the size of the image 
displayed on VDU 120. 

Higher refresh rates will obviously demand a higher powered CPU 130 
10 than lower refresh rates, due to the amount of computing power required to 
resize and re-render any image displayed on VDU 120. 

Furthermore, CPU 130 may take several the last recorded distances and 
compare them, looking for a sequence of near identical distances, which would 
indicate that the user has settled in a particular position and is not moving 
is backwards and forwards, as may occur if user 100 were shuffling in their chair. 
This would minimize any risk of inducing motion sickness in user 100, which 
typically occurs if an image on VDU 120 alters in an unpredictable manner, or 
even appears to move up and down slightly, a problem which affects some 
players of video games. 
20 User 100 can also use hand 140 to construct gestures which are then 

sensed by sensor 110. 

In typical use, sensor 110 emits beam 150 which is reflected off of the 
head or body of user 100, thus sensing the distance between user 100 and 
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sensor 1 10. As sensor 110 repeatedly emits beam 150 and user 100 moves 
away from sensor 110, sensor 110 will see a smooth increase in the distance 
between itself and user 100. 

Any sudden change in the distance sensed between sensor 110 and user 
5 1 00 would mean that user 1 00 either moved out of the field of view of sensor 1 00 
, or that a larger than normal distance was reported, or that user 100 had 
interrupted beam 150 by placing a hand close to sensor 110. 

Any of the sudden change in distance is interpreted by the invention to 
mean that user 100 has placed hand 140 in beam 150, causing sensor 1 10 to 
10 see a sudden decrease in distance between itself and user 1 00. 

This forms the basis of a gesture recognition system found in the 
invention. 

Command is defined as a collection of at least one gesture, where a 
gesture is detected by sensor 1 10 as a sudden change in distance, followed by a 
15 smooth increase or decrease in distance, followed by a final sudden change in 
distance. 

To illustrate; user 100 is positioned at a distance of 1 meter from sensor 110 and 
moves gradually back to a distance of 1.2 meters. Sensor 110 reports the 
smooth increase in distance and CPU 130 interprets this smooth motion as user 
20 100 moving away. However, if user 100 sits at the same distance of 1 meter, 
then raises hand 140 into beam 150 at a distance approximately 0.5 meters from 
sensor 110, sensor 110 will report a sudden change of distance to CPU 130. 
CPU 130 will then interpret this as the beginning of a gesture. User 100 then 
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moves hand 140 away from sensor 110, thus the sensed distance increases. 
CPU 130 then awaits a sudden change of distance again, which signals the end 
of the gesture. As noted above, the sudden change of distance, followed by 
smooth motion, finally accompanied by another sudden change of distance forms 

5 the command. 

The illustrated command can then be used by the invention to either alter 
the magnification factor preferred by user 100, or to scroll or otherwise 
manipulate the image displayed on VDU 120. 

Commands found within the preferred embodiment scroll the image 

10 displayed on VDU 120 up or down, depending on if the command is based on a 
smooth increase or decrease in motion. A smooth increase in distance can be 
interpreted to scroll the image up and a smooth decrease in distance can be 
interpreted to scroll the image down. Other commands can be constructed by 
compounding further sequences of gestures or other commands, such that a 

15 multitude of gestures can be used to control all aspects of the image displayed 
by VDU 120. The other aspects of the image can include brightness, contrast, 
magnification factor, resolution, color intensity, color scheme or other attributes of 
VDU 120 and the displayed image. 

Referring to Fig. 2, a time plot of a simple gesture is shown. Time is 

20 plotted along the X axis and distance is plotted over the Y axis. For simplicity, the 
graph shows a distance of zero for a period of time before point 200, where the 
distance then moves from zero to 0.5 meters substantially instantaneously, which 

i 

is maintained until point 210 where the distance sensed returns to zero once 
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more. Therefore, the plot illustrated in Fig. 2 indicates that an object was 
measured at 0.5 meters from sensor 110 (see figure 1) for a period of time before 
returning to a point substantially closer to sensor 110, 

As shown in Fig. 3, again with time on the X axis and distance on the Y 
5 axis, the distance is smoothly increased from zero to 0.5 meters over a period of 
time. When such a behavior is detected, the invention interprets this as user 100 
is moving away from sensor 110. The inverse behavior, i.e. user 100 moving 
closer to sensor 1 10 would cause the plot to have the opposite slope. 

An alternate embodiment of the present invention could be formed by 
10 utilizing a web camera and a still image capture system (SICS). 

The web camera enables the SICS to capture a scene including user 100. 
The SICS then finds two identifiable points on user 100, for example, the corners 
of the shoulders, the eyes of user 100, or two colored disks attached to user 100. 

The distance between the two identifiable points means that an 
15 approximate distance, between user 100 and the web camera, can be calculated. 
Due to the effects of perspective, from the point of view of the web camera, as 
user 100 moves away from the web camera, the two identifiable points will 
appear to move closer together. 

Once the approximate distance has been calculated, the invention will 
20 then be able to apply an appropriate magnification factor on VDU 110. 

The two colored disks serve the same purpose as small infra-red reflecting 
spheres. These spheres, which are attached to actors, track movement in 
motion capture systems. This method is well known in the art. 
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The two colored disks are a distinct color which the SICS is easily able to 
identify in any captured scene having user 100. Therefore, disks can be used to 
provide two identifiable points. 

The two identifiable points are required to be located in the image of the 
scene captured by the SICS, therefore, SICS searches the image data in order to 
find the approximate centre of the two colored disks. 

Though the alternate embodiment eliminates the requirement for sensor 
1 10, an additional computational load is placed on CPU 130. The additional 
computational load is due to additional processing cycles required to capture a 
still image, analyze the still image to locate the two identifiable points, and finally 
calculate the distance between the two identifiable points. 

The illustrated embodiments of the invention are intended to be illustrative 
only, recognizing that persons having ordinary skill in the art may construct 
different forms of the invention that fully fall within the scope of the subject matter 
appearing in the following claims. 



10 



